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Abstract. This paper deals with the global stability of time-delayed dynam- 
ical networks. We show that for a time-delayed dynamical network with non- 
distributed delays the network and the corresponding non-delayed network are 
both either globally stable or unstable. We demonstrate that this may not be 
the case if the network's delays are distributed. The main tool in our analysis 
is a new procedure of dynamical network restrictions. This procedure is use- 
ful in that it allows for improved estimates of a dynamical network's global 
stability. Moreover, it is a computationally simpler and much more effective 
means of analyzing the stability of dynamical networks than the procedure 
of isospectral network expansions introduced in [3]. The effectiveness of our 
approach is illustrated by applications to various classes of Cohen-Grossbcrg 
neural networks. 

1. Introduction 

The study of networks in nature, science, and technology is an extremely active 
area of research. Because of the structural complexity and considerable size of many 
networks a good deal of this research has been devoted to understanding the static 
features of these systems [51 O [TUl H2J E3 HZ] ■ However, most real networks are 
dynamic. That is, each network element has an associated state that changes with 
time. Additionally, because of finite processing speeds and transmission of signals 
over distances, the dynamics of such networks are inherently time-delayed. 

To investigate the dynamical properties of networks, a general approach was 
introduced in fj. The major idea in this work is that a network's dynamics can 
be analyzed in terms of three key features; (i) the internal local dynamics of the 
network elements, (ii) the interactions between the network elements, and (iii) the 
topology or structure of the graph of interactions of the network. In [1] it was 
shown that each of these network features (including the network topology) can be 
interpreted and investigated as a dynamical system. 

In this paper we extend this mathematical formalism to investigate the dynamics 
of time-delayed dynamical networks. That is, we consider dynamical networks in 
which the network's interaction includes time-delays. In such systems it is therefore 
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possible for network elements to interact over large as well as multiple time-scales, 
which can have a significant impact on the network's dynamics. 

The particular type of dynamics we consider in this paper is whether a time- 
delayed dynamical network has an evolution that is stable, i.e. whether a network 
has a globally attracting fixed point. Specifically, our goal will be to describe what 
type of time-delayed interactions stabilize a given set of local systems. Our first 
major task in this regard is to understand how transforming a network, by cither 
adding or removing time-delays to its interaction, effects the network's stability. 
A second related task is to determine under what conditions such transformations 
can be used to gain new information about the original network. 

With respect to this first task we note that by modifying an interaction's time- 
delays it is possible to destabilize a stable network or conversely, stabilize a network 
that has unstable dynamics. However, one of the main results in this paper is that 
if a time-delayed dynamical network is known to be stable then the undelayed 
version of this network will also have stable dynamics (see theorem 4.2). That is, 
by removing the time-delays in a stable network's interaction we do not change the 
network's dynamics in any essential way. 

Conversely, the addition of delays to a network's interaction may result in a 
network with unstable dynamics even if the original network has a globally attract- 
ing fixed point. In the case where the state of each network element Xi depends 
on at most one of the previous states of any element Xj we say the network has 
non-distributed delays and has distributed delays otherwise (see definition 4.3 1. We 
show that if a time-delayed dynamical network is stable and has a non-distributed 
interaction then any change in the interaction's time-delays does not effect the 
network's stability (see theorem |4.4| ) 

This result allows us to analyze the dynamics of any time-delayed network as a 
network without delays if it has a non-distributed interaction. This is advantageous 
from a computational point of view since it is significantly simpler to investigate 
the stability of an undelayed network than a network with delays. 

With this theory in place we consider the class of dynamical networks known 
as Cohen-Grossberg neural networks [I] whose stability has received a considerable 
amount of attention. See for instance HI [HJ [HI [T5l [16] . By applying our theory 
to such systems we are able to derive new criteria for the stability of both the 
delayed and undelayed versions of this class of networks. 

To further apply this theory we note that one of the major obstacle in deter- 
mining the dynamic behavior of a network (or high-dimensional system) is that the 
information needed to do so is spread throughout the network components. In [3] 
it has been shown that a network can be modified in a number of ways that pre- 
serve its dynamics while concentrating this network information. This concept of a 
dynamical network expansion allows for improved estimates on whether a network 
has a globally attracting fixed point. However, this improved ability to determine 
a network's stability comes at the price of needing to analyze the stability of a 
higher-dimensional dynamical network. 

By combining the theory of dynamical network expansions with our present 
results on time-delayed networks we are able to develop a new theory of dynamical 
network restrictions. Such restrictions are lower-dimensional versions of a given 
network which have a less complicated structure of interactions. We show that 
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if a dynamical network is stable then any restriction of this network inherits this 
stability (see theorem 6.2 1. 

To investigate the stability of a network via one of its restrictions we introduce 
the notion of a basic structural set which is related to the idea of a non-distributed 
interaction. The major result in this direction is that if a network is restricted to 
a basic structural set and the restricted network is known to have stable dynamics 
then the same holds for the original network (see theorem 6.4 1. 

As with network expansions, such restrictions allow for improved estimates of a 
dynamical network's global stability. However, the computational effort required 
to construct and analyze these restrictions is far less when compared with that of 
dynamical network expansions. 

One reason for this simplicity is that dynamical network expansions essentially 
preserve the entire spectrum of the network. However, to analyze the global stability 
of a network one does not need to know its entire spectrum but rather only the 
network's spectral radius. As we have a relationship between the spectral radius 
of a network and the network restricted to a basic structural set we are able to 
analyze the stability of one in terms of the other although the two may have very 
different spectra. 

The results and topics in this paper are organized as follows. Section 2 introduces 
the concept of a dynamical network and gives a sufficient condition under which such 
systems have a globally attracting fixed point. Section 3 then defines a time-delayed 
dynamical network and extends this stability criteria to networks with time-delays. 
Following this section 4 considers how changes to a network's time-delays effects 
the network's stability and introduces the concept of a non-distributed interaction. 

The second half of the paper, consisting of sections 5 and 6, integrates the theory 
of dynamical network expansions in section 5 with the results of sections 3 and 4. 
The result, given in section 6, is the notion of a dynamical network restriction and 
that of a basic structural set, which are used in this section to obtain improved 
stability estimates of both delayed and undelayed dynamical networks. 

Lastly, we note that each of the results in this paper is illustrated by exam- 
ples. Moreover, although our procedure deals with matrices and is therefore linear 
in nature, it does not in fact have this restriction and is applicable without any 
modifications to general nonlinear dynamical systems. 



2. Dynamical Networks and Global Stability 

As mentioned in the introduction, dynamical networks or networks of interacting 
dynamical systems are composed of (i) local dynamical systems which have their 
own (local intrinsic) dynamics, (ii) interactions between these local systems (ele- 
ments of the network), and (iii) the graph of interactions (topology of the network). 



2.1. Dynamical Networks. Following the approach in [TJ[3], dynamical networks 
are defined as follows. Let i 6l = {l,...,u} and (fi : Xi — > Xi be maps on the 
complete metric space (Xi,d) where 

/•n T d(<Pi{Xi),<pi(yi)) 

(1) U = sup — r < 00. 



4 



L. A. BUNIMOVICH 1 AND B. Z. WEBB 2 



Let (ip,X) denote the direct product of the local systems (<pi,Xi) over X on the 
complete metric space (X, d max ) where for x, y £ X 

d m ax{x,y) = max{d(xi,yi)}. 

Definition 2.1. A map F : X —> X is called an interaction if for every j £ X there 
exists a nonempty collection of indices Xj C X and a continuous function 

F . :0.V, -A,. 

where the map F is defined as follows: 

F(x)j- = J F i (x|i.), j'el, and xGX 

The superposition J 7 = F o tp generates the dynamical system (J 7 , X) which is a 
dynamical network. 

Suppose F satisfies the following Lipschitz condition for finite constants A i:) > : 
(2) ^(x^O^-CyM) < £ A^-d(x ijW ) 

for all xjeX where x|j. is the restriction of x e I to (Biex A^- 

The Lipschitz constants A^ in equation ([2]) form the matrix A e M™ x ™ where 
each Ay > and where Ajj = if i ^ X,-. For the dynamical network (J 7 , X) we 
call the matrix 

(AuLi . . . A n iL n \ 
j : 
Ai„Li . . . A nn L n J 

a stability matrix of (J 7 , X). 

Definition 2.2. The dynamical network (J 7 , X) has a globally attracting fixed point 
x e X if for any xel, 

lim rf„ la2: (j" fe (x),x) = 0. 

fe— ►oo 

If (J 7 , X) has a globally attracting fixed point we say it is globally stable. 

The local systems (ip, X) are said to be stable if ((p, X) has a globally attracting 
fixed point and are said to be unstable otherwise. The interaction F : X — > X 
is said to stabilizes the local systems (ip, X) if the local systems are unstable but 
the dynamical network (J 7 , X) has a globally attracting fixed point. If the local 
systems (<p, X) are stable and (J 7 , X) has a globally attracting fixed point we say 
the interaction F : X —> X maintains the stability of (ip, X). 

One of the major goals of this paper is to find sufficient conditions under which 
an interaction stabilizes a set of local systems. For a matrix A € K nx ™ let p(A) 
denote its spectral radius, i.e. if cr(A) are the eigenvalues of A then 

p(A) = max{|A| : A G a(A)}, 

The following theorem is found in [3] (see theorem 2.5). 

Theorem 2.3. Suppose A is a stability matrix the dynamical network {T,X). If 
p(A) < 1 then the dynamical network (J 7 , X) has a globally attracting fixed point. 
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In other words, theorem |2.3| states that if p{A) < 1 then the interaction F 
stabilizes (or maintains the stability) of the local systems (tp,X). 

Suppose the maps (p : X — > X and F : X — > X are continuously differentiable 
and each X, C R is a closed interval. If the constants 

(3) Li — max |^(xj)| < oo 

x£ X 

(4) Aij = max | (DF)^ (x) | < oo 

where DF is the matrix of first partial derivatives of F then we say F £ C^ (X). 
For F £ C} yo {X) the matrix A T • diag[Li, . . . , L n ] given by ^ and Q is a stability 
matrix of (F, X). As this matrix is unique then for any F £ C] Xl {X) we let 

p{F) = p(A T ■ diag[Li, ...,L n }). 

For matrices A,B£ R" x " we write A < B if A^ < for each 1 < i,j < n. 
The matrix A £ R™ x ™ is nonnegative if the zero matrix < A. If it is known that 
< A < B then p(A) < p(B) (see [5] for instance). This can be used to show the 
following. 

Proposition 1. Let F £ C^ a (X). If A is any stability matrix of (F,X) then 
p(F)<p(A). 

Proof. Suppose F £ C^(X) and that A — A T -diag[Lx, . ■ . , L n ] is a stability matrix 
of (F, X). Let &i be the ith standard basis vector of R n . For x £ X let h ^ such 
that y = x + he, £ X. Then by 

d(F j (x\ Xj ),F j (y\ Xj )) < Aijdix^Xi + h) = A i:j \h\. 

Hence, \F(x)j — F(y)j\/\h\ < Ay. Taking the limit as h — >■ implies 

l-DF^x)! < Aij for all xel 

Letting Ay = max xeA - |.DF.,-i(x)| then < A < A. 

Similarly, one can show that Li = max xe x < Li. Hence, the matrix 

A T • diag[L x , . . . , L n ] < A implying p(F) < p(A). □ 

For F £ C} a (X), proposition [l] implies that p(F) is optimal for directly deter- 
mining via theorem 2.3 whether (F, X) is globally stable. 

2.2. Cohen-Grossberg Neural Networks. Consider the following local system 
{(fii,M.) given by 

(5) <Pi{xi) = (1 - e)xi + Ci 

where Ci,e £ R and 1 < i < n. Notice that the local systems (<p,R ra ) are stable if 
and only if 1 1 — e | < 1. The major question we consider is what kind of interaction 
stabilizes or maintains the stability of these local systems. 

For the local systems §5§ we are specifically interested in interactions of the form 



(6) F .(x)= Xj+ Y,Wi j ct>i(^— i 

where f ^ 1, W £ R" xn and 4>i : R — > R is any smooth sigmoidal function with 
Lipschitz constant L > 0. The reason we study this particular interaction is that 
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the dynamical network (J 7 , X) is then given by 
(7) J- i(x ) = (i _ e ) Xj 



( Xi ) + Cj 



which is a special case of the Cohen-Grossberg neural network in discrete time [I] . 

For such neural networks the variable Xi represents the activation of the i-th 
neuron population. The function 4>i(xi) describes how the neuron populations 
react to inputs. A typical example is the function (j)i( x i) = tanh(£xj), see |16| . 
The matrix W gives the interaction weights between each of the i-th and j-th 
neuron populations describing how the neurons are connected within the network. 
The constants Cj indicate constant inputs from outside the system. 

As mentioned in the introduction, there is considerable interest in determining 
stability conditions for such networks in general. See for instance [51 [51 HI]. To apply 
our theory to this problem we denote by \W\ the matrix with entries \ W\ij = \Wij\. 
Using this allows us to prove the following general stability condition for this class 
of Cohen-Grossberg neural networks. 

Theorem 2.4. (Stability of Cohen-Grossberg Neural Networks) Let (J 7 , E") 
be the Cohen-Grossberg network given by where </>,; has Lipschitz constant C If 
|1 — e| + £p(|W|) < 1 then (J 7 , M n ) has a globally attracting fixed point. 

Proof. Assuming J- is given by then T G CL(R). The claim then is that 
for the local systems and interaction given by ([H]) and ^ the matrix A = A T ■ 
diag[Li, . . . , L n ] with 

Li = |1 — e|, and 



max IVifc)! 

x6X 



max\(DF)ji(x.)\ < A^- = 




for 
for 



* = J 
i + 3 



is a stability matrix of (J-, X). To see this note that the constants 

Aij = max|(L>F) J2 (x)| 

satisfy Since A^ < Aij then similarly the constants Ay satisfy ^ verifying 
the claim. 

Notice that the matrix A has the form 

-\l-e\ + \W u C\ \W 12 C\ ... \W ln C\ 

\W 2 iC\ II -el + 1^22^1 ... \W 2n C\ 



(8) 



A = 



II -el 



\W n nC\ 



II 



C-p(\W\) 



\W nl C\ \W n2 £\ 

The spectral radius of the matrix A is then 

p(A) = p(\l - e\I n + C\W\) 

where J„ is the n x n identity matrix. From theorem 2.3 it follows that (J r ,M n ) has 
a globally attracting fixed point if |1 — e| + Cp(\ W\) < 1 implying the result. □ 

To the best of our knowledge theorem [2^4] is a new stability criteria for this class 
of neural networks. However, the major goal of this paper is to extend such results 
to the case where the network's interactions include time delays. To do so requires 
a better understanding of the graph structure of dynamical networks. 
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Figure 1. The graph of interactions of the Cohen-Grossberg type 
network in example 1. 



2.3. Graph Structure of Dynamical Networks. To each dynamical network 
(J 7 , X) there is an associated unweighted directed graph called its graph of inter- 
actions. An unweighted directed graph G is an ordered pair G = (V, E) where the 
sets V and E are the vertex set and edge set of G respectively. If the vertex set 
V = {i>i, ...,«„} then we denote the directed edge from Vi to Vj by e^. 



Definition 2.5. The graph Tj- — [V, E) with vertex set V = {v\, 



,} and edge 



set E = {eij : i £ Xj, j el} is called the graph of interactions of the dynamical 
network (J 7 , X). 

Each vertex vi € V of Tjr = (V, E) corresponds to the ith element of the dynam- 
ical network (J 7 , X). Also, there is an edge £ £ or a directed interaction from 
the ith to the jth element of the network if and only if the jth component of the 
interaction F(x.) depends on the ith coordinate of x. 

Example 1. Suppose the map J- : X — > X is given by 

^(x) = (1 — e)xj + a[tanh(&iEj_i) + tanh(6iEj + i)] + cj 

for 1 < j < n where the indices are taken mod n, Xi = R, a, 6, Cj € R, and 
e =/= 1. Notice that this has the form of a Cohen-Grossberg network given by 
where 4>i{xi) — t&?a\i{bxi) has Lipschitz constant \b\. The graph of interaction of the 
system (J 7 , lZ n ) is shown in figure 1 for e ^ 1. 

Moreover, it follows that the matrix \ W\ is given by 



\W\ = 





I a. I 



|«| 




for this system. Since \ W\ has nonnegative entries and constant row sums 2\a\ then 
= 2|a|. By theorem 2.4 if |1 — e| + 2|a&| < 1 then the dynamical network 
(J 7 , R") has a globally attracting fixed point. 



2.4. Dynamical Networks Without Local Dynamics. By definition 2.1 the 
function J- = F o ip is the composition of the network's local dynamics <p and 
interaction F. However, if the system has no local dynamics, i.e. (p = id is the 
identity map, then the dynamical network (J 7 , X) = {F, X) is simply the interaction 
T = F on X. 
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Conversely, notice that F = F o ip can itself be considered to be an interaction. 
Writing F — (F o ip) o id the dynamical network (F, X) is simply the interaction 
F = F o ip with no local dynamics. Since this is formally the same dynamical 
network we call it the dynamical network {F, X) considered as a network without 
local dynamics. 

Proposition 2. Suppose (F,X) is the dynamical network with no local dynamics. 
If the constants Ay satisfy for T = F then A T is a stability matrix of (F, X). 

Proof. If (F, X) has no local dynamics then tp.i — id implying Li — 1 satisfy 
equation (HJ). Hence, the matrix A T ■ diag[Li, . . . , L n ] = A T is a stability matrix of 
(F, X) under the assumption that the constants satisfy ([2| for F = F. □ 

Remark 1. If F 6 C} X) {X) then proposition [2] implies that the matrix A T with 

Aij = max|L)J : "j i (x)| 

is a stability matrix of {F , X) if the network has no local dynamics. 

Proposition 3. If A is a stability matrix of (F, X) then A is a stability matrix of 
(F, X) considered as a network without local dynamics. 

Proof. Suppose A is a stability matrix of (F, X) where F = F o ip. Then A = 
A T ■ diag[L\, ...,L n ] implying Sij ~ AjiLj where Li and Ajj satisfy and ([2]) 
respectively. Therefore, 

d(^-(x),^(y)) =d(F,( ¥ >(x)| Ij ),F J .( ¥3 (x)| I .)) < 
Aijd((pi(xj), (fi(yi)) < A ij L i d(x l ,yi) 

for all j El and x, y E X. Since Af^ — A.yLj then proposition [2] implies that A is 
a stability matrix of (F, X) considered as a network without local dynamics. □ 

The reason we consider dynamical networks without local dynamics is that this 
notion is useful in the study of the global stability of time-delayed networks intro- 
duced in the following section. 

3. Global Stability of Time-Delayed Dynamical Networks 

Our first task in this section is to extend the formalism of the previous section 
to dynamical networks with time-delays. This requires that we allow the state 
F k+1 (x) of the dynamical network (F, X) to depend not only on F k (x) but on 
some subset of the previous T states {^(x), J rfc_1 (x), . . . , F k ~( T ~^(x)} of the 
system. 

3.1. Time-Delayed Dynamical Networks. Given the fixed integer T > 1 let 
T = {0, -1, . . . , —T + 1} and let X T = X for all t e T. We define the product 
space 

rer 

For the local systems (ifi,X) we define the function tp : X T — > X T as follows. For 
(x°,...,x- T+1 ) EX T let 

^(x ,...,x- r + 1 ) = (^(x ),...,^(x- r + 1 )) 
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where <^(x°, . . . , x T+1 )l = <Pi(xJ) for (i, r) el x T. Adopting the terminology of 
the previous section we say (</?, A T ) are local systems. 

Definition 3.1. A map H : X T — > A is called a time- delayed interaction if for all 
j e I there is a set P C I x T and a continuous function 

The map 7? is defined as follows: 

H(-x.)j = Hj(x.\ xj ), j el, and x e A T . 

The superposition "H = iJoi^ generates the time-delayed dynamical network (H, X T ). 
The orbit of (x°,x _1 , . . . , x~ T+1 ) e X T under % is the sequence {x fe } / t > _T where 

x fe+1 =H(x fe ,x fe - 1 ,...,x fe -( T - 1 )). 

As before, we are concerned with finding sufficient conditions under which a 
time-delayed dynamical network has a globally attracting fixed point. 

Definition 3.2. A fixed point of a delayed dynamical network (H, X T ) is an x e X 
such that x = "H(x, . . . , x). The fixed point x e X is a global attractor of ("H, X T ) 
if for any initial condition (x°, x _1 , . . . , x~ T+1 ) e A T the limit 

lim d TOOX (x fe ,x) = 0. 

To connect the study of delayed dynamical networks with the dynamical net- 
works introduced in section 2 we construct the following. For the delayed dynamical 
system (H, X T ) we define the index set 

Ifl = {i,j;£,m : 1 < j < n, (i,m)Gl 3 , l<£<m}. 

Let Hj : X T — > Xj be the function Hj(x k , . . . , x fc ~( T_1 )) in which each time- 
delayed variable x\~ m is replaced by Xi.j- m . m for m > 1 and each x\ by Xi. For 
each 5 Gl-n let %a = 'Hi,j-e,m be the function 

(9) T~Li,j;£,m{%i,j;£—l,m) — l,m 

where Xij ; o, m = ^i- Define the product space 

(10) A-« = jx e A ( X,^ : Xij-i, m = x a ,f, u ,v if i = s, ^ = w| 

<5ez H 

where X it j.^ m is a copy of the space X 4 . Let : X^ — > X n be the function 

^=(e^)i(©4 

jei sei n 

The function A/% : X-h — > X^ generates the dynamical network (J\ffi,Xfi). 
However, because of the time-delays involved and the potential noninvertability of 
the local systems (ip, A T ), the dynamical network (J\f-u,X-u) cannot typically be 
represented as a network with local dynamics. We therefore consider (Afn, X-h) as 
a network with no local dynamics. 

Theorem 3.3. The time-delayed dynamical network (H,X T ) has a globally at- 
tracting fixed point if and only if the same is true of (J\fu,Xu). 
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Proof. To compare the dynamical systems (H,X T ) and {Mui^h) we define the 
mapping H '■ X T — > X T by 



(x 



fc+i 



, X 



fc-T+2 



) =H(x fc ,x fc 



k-1 



Jc-(T-l) 



for all k > 0. The claim is that the systems (H,X T ) and (Af-n,X-n) are conjugate. 
To verify this we let the map it : X T — > X<n be given by 



7r(y)<5 



Ui 



i e 1 

i,j;£,m e Z n 



We note that it follows from ( 10 ) that 7r is a bijection. 

Let x = (x°,...,x- T+1 ) G X*. As ttoH(x) = tt("H(x),x , 



, x T + 2 ) then 



■H(x)), 



«i(x), 



i G 1 

i,j;£,m£ 1 H 



Also, we have 

(Afoo7r(x)) 4 



^(7r(x)), 



l,m ) 



6 = ieX 

S = i,j;£,m G I« 



For i € X, Hi : X T —> is the function 7^ in which each variable m is 
replaced by Xi.j- m . m and x® by a;,. As this is the same as mapping x to 7r(x) then 
•Hj(x) = %(tt(x)). Moreover, as Wi,j^, m (7r(x) i>J -^_i im ) = 7r(x) ijJ -^_i )OT = x.^^ 1 
then 

7T O H(x) = A/« O 7r(x). 

As 7r is a bijection then (Ji,X T ) and {Nu,X H ) are conjugate verifying the claim. 
Therefore, (H,AT T ) has a globally attracting fixed point if and only if (Nu,Xn) 
has a globally attracting fixed point. 

Since %(x) is simply the restriction 2£(x)|x° then (il,X T ) is globally stable if 
and only if the same is true of (H, X T ) implying the result. □ 



By combining the results of thcorems |2.3| and |3.3| it is possible to investigate the 
dynamic stability of (H,X T ) via its associated dynamical network (A/h,X%). 

Corollary 1. Suppose A is a stability matrix of (Nji, Xu) . If p(A) < 1 then 
{T-L,X T ) has a globally attracting fixed point. 

In light of corollary [l] we say A is a stability matrix of {%, X T ) if it is a stability 
matrix of (M-h,X^). Moreover, if A/% G C^Xji) we will write p(Ji) = p(Afn)- 

Example 2. Consider the delayed dynamical network (H,X T ) given by 

(1 - e)^' -1 + 2atanh(&a;2~ 3 ) + c\ 



(11) H{x k ,x' 



) = 



(l-e)x% 1 + 2a tanh(6o;i 3 ) + c 2 
with local systems (fi(xi) = (1 — e)xi + Cj for i — 1,2 and interaction 

- k - 1 ' 2at&nh(b x \_- C2 ) 



(12) 



H{x k ,x' 



l 

fe-l 



u, 2 -r 2atanh(b ^ 1 ) 

where a, b, c% G M, X = R 2 , and e ^ 1. iVoie that this system is a delayed version of 
the Cohen-Grossberg network described in example 1 for n = 2. Such time-delayed 
systems have been of recent interest. See for instance P^IITSIHB] . 
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Since I 1 = {(1, -1), (2, -3)},. I 2 = {(1, -3), (2,-1)} and T — 4 the 



Z-h = {11; 11, 12; 13, 12; 23, 12; 33, 21; 13, 21; 23, 21; 33, 22; 11} 
and the components of the function T-L are given by 

H 



(1 
(1 



e)£ll;ll 



2atanh(6a;2i;33) + c\ 
2atanh(6xi2;33) + c 2 



Following our construction the function Af-u is then defined as 



CA/W)i(a;ii;ii,a;2i;33) 




" 


(■A/W)2(2Cl2;33»a!22;ll) 




(1-e 


(A/«)ll;ll(Xll ; Ol) 






(■A/«)l2;13(a;i2;03) 




Xi 


(A/«)l2;23(^12;13) 




^12;13 


(A/«)l2;33(a ; 12:23) 




^12;23 


(A/«)21;13(^21;03) 




x 2 


(■A/w)21;23(^21;13) 




2 ; 21;13 


(A/"«)21;33( a; 21:23) 




£21;23 


CA/W)22ill(»22;0l) 




_ a; 2 



2atanh(6a;2i ; 33) + ci 
2atanh(6xi2;3 3 ) + c 2 



-ffere, a; G X-h 



)10 



where the component in 



^12:13 OTid fie component 



£21:13 = £22:11- A/« G 



') £/ien proposition^ implies that the constants 
\( DJ ^H)ji(x)\ 



form the stability matrix 



A J 



|l-e| 00 2|o6| 











1 





1 



2|o&| 








1 





1 
1 


































From this one can compute that 



(13) 



p(H) = 



\ab\ 



Importantly, p(H) < 1 if and only if |1 — e| + 2\ab\ < 1. By corollary^ the time- 
delayed interaction H stabilizes the local systems (ip,X T ) if\l — e\+2\ab\ < 1, which 
is the same condition derived in example 1 for the global stability of the undelayed 
version of this system. 

With this example in mind we turn our attention to determining how modifi- 
cations of an interaction's time-delays effects whether the associated time-delayed 
network has a globally attracting fixed point. 
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u 12;13 u 12:23 u 12;33 



''1 



^11;11 V 2 2;ll 



^21;33 1'21;23 ^21;13 

Figure 2. The graph of interactions r_A/ w and Tn n corresponding 
to (J\f-H,X-n) and (U-h,X) in examples 2 and 3 respectively. 



4. Removing Time-Delays 

In this section we describe how modifying an interaction's time-delays effects a 
network's stability. Our first result is that if a time-delayed dynamical network is 
known to have stable dynamics then removing these time-delays will not destabilize 
the network. However, the converse of this statement does not hold. In fact, we give 
an example of an undelayed network with stable dynamics that becomes unstable 
with the addition of delays. 

On the other hand, if time-delays are introduced in a specific way into a network's 
interaction the time-delays will not be able to destabilize the network. Interactions 
with this property are called non- distributed. This concept allows us to study the 
dynamic stability of delayed networks with such interactions in terms of undelayed 
networks, which is significantly simpler from a computational point of view. 

4.1. Undelayed Dynamical Networks. Here we formalize the notion of mod- 
ifying a system's time-delays. Our first objective is to describe how to change a 
delayed dynamical network to a network without time-delays. 

Definition 4.1. Let {T-L,X T ) be the time-delayed dynamical network with local 
systems (p, X T ) and interaction H : X T — > X. The map Uu '■ X — > X given by 

W w (x)=-W(x,...,x) 

generates the undelayed dynamical network (Uu,X) with local systems (<p, X) and 
interaction Uh ■ X — > X defined as 

W ff (x) = JT(x,...,x). 

Simply put, (U-HtX) is the delayed dynamical network (H,X T ) with its delays 
removed. The following result relates the dynamic stability of the undelayed net- 
work (Un,X) to the stability of (U,X T ). 

Theorem 4.2. Suppose A is a stability matrix of the time-delayed dynamical net- 
work ('H,X T ). If p(A) < 1 then the undelayed dynamical network (U-h,X) has a 
globally attracting fixed point. 

That is, if a time-delayed interaction is known to stabilize or maintain the sta- 
bility of a set of local systems then the undelayed version of this interaction will do 



the same (see example 4). However, the converse of theorem 4.2 does not hold as 
the following example shows. 
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Example 3. (A Stable Undelayed Network Associated with an Unstable 
Delayed Network) Consider the time-delayed dynamical network (H,X T ) given 



by 



(1 - e)x\ + tanh(6x|) - tanh^ -1 ) 



(1 - t)x\ + tanh(fa^) - tanh^- 1 ) 

where e = 1/2. 6=1, and X = K 2 . For simplicity we consider (H,X T ) as a 
delayed network with no local dynamics. Notice that the map 

(1 — e)x\ + tanh(6x2) 
(1 — e)x2 + tanh(&a;i) 

Xl 

X-2 



{Nu)l{xi,X2,Xl2-n) 
(^)l2;ll(^l) 
(■A/k)21;1i(^2) 



tanh(6x2i ; ii) 
tanh(6xi2 ; ii) 



has the fixed point x = (0, 0, 0, 0) € 



As the matrix 



1-e b 

b 1-e 
1 
1 



it follows that p(DAf H (x)) = (1 + \/l7)/4 > 1. Hence, x is a repelling fixed point 
of(Af n ,X n ). 

Since (Af-n,X-u) does not have a globally attracting fixed point the same holds 
for {H,X T ) by theorem 3.3 However, the undelayed dynamical network 
is given by 

U n {.x) = 

which has (0, 0) £ K 2 as a globally attracting fixed point. 

Hence, it is possible when removing time-delays to effect the global stability of 
a system. Moreover, even though (U^,X) has a globally attracting fixed point the 
network (T-L,X T ) has no stability matrix A with the property p(A) < 1. 



" (l-e)ari " 


1 


Xl 


. (l-e)* 2 _ 


~ 2 


X 2 



Theorem |4.2| does however have a partial converse if we restrict ourselves to 
specific types of time-delayed interactions. Recall from definition |3.1| that a time- 
delayed interaction is a function H : X T —> X given by 



Hi 



XI 



x, 



where the set I J Clx T. 



Definition 4.3. The time-delayed interaction H : X T — > X is called non- distributed 
if for all j G X the set P C I x T has the property that 

(i, p) e X 3 => (i, v) V for all v ^ fi. 

If a time-delayed interaction does not have this property we say it is distributed. 

Equivalently, H : X T ->• X is a non- distributed interaction if for each i,j el 
the component Hj depends on at most one variable of the form x\. If (%, X T ) has 
an interaction which is non-distributed then we say the network (H,X T ) is also 
non-distributed and write (H,X T ) 6 nd(X T ). 
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Theorem 4.4. Suppose (H,X T ) <E nd(X T ). Then there is a stability matrix A of 
(H,X T ) with the property p(A) < 1 if and only if there is a stability matrix A of 
{U n ,X) with p(A) < 1. 

Therefore, if a time-delayed dynamical network is stable and has a non-distributed 
interaction then any change in the interaction's time-delays that maintains this 
property does not effect the network's stability. The following is an immediate 
corollary of theorems |2.3| and |4.4| 



Corollary 2. Suppose (H,X T ) € nd(X T ) and that A and A are stability matrices 
of (H,X T ) and (U-h,X) respectively. If either p(A) < 1 or p(A) < 1 then both 
(H,X T ) and (U-u,X) are globally stable. 



is the dynamical network (Uu,X) 



Example 4. Consider the time-delayed dynamical network (T-l,X T ) given by (11) 
in example 2. The undelayed version of (H, X T ) 
given by 

(1 — e)x\ + 2atanh(6.T2) + C\ 
(1 — e)x2 + 2atanh(6a;i) + C2 
- e)xi + Cj and interaction 

x 1 +2at&nh(b^fE s r) 
x 2 + 2at&nh(b : ^^) 



Unix) 

with local systems <pi(xi) = (1 

U H {x) = 



where i € {1, 2}, a, b, Ci £ K, X = M 2 , and e ^ 1. Using Ajj = max ie x \{DlA}i)ji{x)\ 
and the constants Li = max^gX; | ( Pi( a; i)l one has the stability matrix 

" |l-e| 2|ab| 



2\ab\ 



A • diag[Li, L 2 ] = 

I 2 ) from which it follows that 

p{U H ) = |l-e| + 2|afi|. 



1 



of{U n , 
(14) 

As can be seen from (12) the dynamical network (T-L,X T ) 6 nd(X T ). Theorem 4-4 
then implies that the time-delayed interaction H stabilizes the local systems (if, X 1 ) 
i/|l-e| +2|o6| < 1. 

It is important to note that the same condition was formulated in example 2. 
However, the computations used to find p(Uu) in this example are much simpler 
than those required to find p(H) in example 2. In fact, from a computational point of 
view, it is always easier to analyze the stability of an undelayed dynamical network 
(Un,X) than the time-delayed network i(H,X T ). 

We note that if a time-delayed dynamical network (H, X T ) is distributed, i.e. has 
a distributed time-delayed interaction, then the conclusions of theorem |4.4| may not 
hold. For example, the dynamical network (U-h,X t ) in example 3 has the stability 
matrix 

1/2 
1/2 

with p(A) < 1. However, (T-L,X T ) does not have a globally attracting fixed point. 
The reason being is that {%, X T ) ^ nd(X T ). 

Example 3 also points out that certain types of time delays can be destabilizing to 
a system. On the other hand, theorem |4.4| states that if time-delays are introduced 
into a stable system in specific ways the resulting system will remain stable. More 
precisely, if delays are introduced into an undelayed interaction F in a way that 



.4 
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results in a non-distributed interaction H this modification will not destabilize the 
network's dynamics. 

4.2. Cohen-Grossberg Networks with Time-Delays. To apply the results of 
section 4.1 to the Cohen-Grossberg networks considered in this paper suppose 
(H,X T ) is the time-delayed dynamical network given by 

n 

(15) n^ k , x^-D) = (1 - e)x)~ r " + ]T W^{x k r^) + <H 

i=l 

with local systems <Pi(x{) = (1 — e)Xi + Cj and time-delayed interaction 

(16) if(x fc , x*-^" 1 )) = x)~ r " + ^K^T^T 

i=l 

Here, 1 < i,j < n, < < T - 1, and e ^ 1. As before W £ R nx ", X = R n , and 
4> : K — » K is a smooth function with Lipschitz constant C. 

Equations (151 and (161 describes the Cohen-Grossberg network (T~L, R " T ) with 



time-delays. Since {H,X ) £ nd(X ) then as a corollary to theorem 2.4 and 
theorem 4.4 we have the following result. 

Theorem 4.5. (Stability of Time-Delayed Cohen-Grossberg Networks) 

Let (7l,W lT ) be the time-delayed Cohen-Grossberg network given by (15) where <fii 
has Lipschitz constant C. If |1 — e| + £/3(|M^|) < 1 then (T-L,M. nT ) has a globally 
attracting fixed point. 



The point of theorem |4.5| is that although time-delayed Cohen-Grossberg net- 
works are more complicated systems than Cohen-Grossberg networks without de- 
lays, the criteria for their stability is not. 



4.3. Proving Theorem |4.2| and Theorem 4.4 In order to prove theorems 4.2 



and theorem 14.41 we will use the well known theorem of Perron and Frobenius and 
the following standard terminology. 

A weighted directed graph G = (V, E, uj) is a graph with vertices V, edges E, 
where the edge £ E has weight u>(eij). A path P in G is an ordered sequence 
of distinct vertices vi,...,v m £ V such that e^i+i £ E for 1 < i < m — 1. The 
vertices «2, ■ • ■ ,w m -i are the interior vertices of P. In the case that the interior 
vertices are distinct, but v\ = v m , then P is a cycle. A cycle v\, . . . , v m is called a 
loop if m = 1. 

A directed graph G is called strongly connected if there is a path from each vertex 
in the graph to every other vertex or G has a single vertex. The strongly connected 
components of G are its maximal strongly connected subgraphs. 

The weighted adjacency matrix of a weighted directed graph G = (V, E, lu) is the 
matrix M with entries Mij = uj(eij) where = if ey ^ E. We say the graph G 
is the graph associated with its weighted adjacency matrix M. If M £ R nxn then 
M is said to be irreducible if the graph G associated with M is strongly connected. 
Moreover, the matrix M is nonnegative if My > for all 1 < i, j < n. 

Theorem 4.6. (Perron- Frobenius) Let M £ M. nxn and suppose that M is irre- 
ducible and nonnegative. Then 

(a) p(M) > 0; 

(b) p(M) is an eigenvalue of M; 

(c) p(M) is an algebraically simple eigenvalue of M; and 
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Vf I 




G 



Go 



Figure 3. The edge ei m in G and its modified form in Gg where 
M tm = a + C 



(d) the left and right eigenvectors x and y associated with p(M) have strictly 
positive entries. 

If a graph G is not strongly connected then it has strongly connected components 
S(G)i . . . , S(G)n- Let M be the matrix associated with G and Mj the matrix 
associated with §j(G). Then the eigenvalues are 

N 

a(M) = |J er(-Mj) 
i=i 



(17) 

from which it follows that 
(18) 



p(M) = max p(Mj). 

l<j<N 



We call a strongly connected component Sj (G) trivial if it consists of a single vertex 
without loop in which case a (§j(G)) = {0}. The following result is found in 0. 

Proposition 4. Let A, B £ K nxn be nonnegative and suppose that A is irreducible. 
Then p{A + B) > p(A) ifB^O. 

That is, the spectral radius of a nonnegative irreducible matrix is strictly mono- 
tonic in each of its entries. 

Suppose M £ M raxn is nonnegative and a > 0,C > such that a + C = Mi m 



for fixed integers 1 < £, m < n. Let Mg 
matrix M given by 



(Mg)i 



Mg(a,C) e E™+ lx «+ 1 be the modified 



'm 13 


for l<i,j 


< n, ^ {£,m 


o 


for (i, j) = 


(0,m) 


C 


for (i, j) = 


(t,m) 





for (i, j) = 


(£,0) 





otherwise 





for < i,j < n and 8 > 0. If G and Gg are the graphs associated with M and Mg 
respectively the difference between these graphs is shown in figure 3. 

Lemma 4.7. Suppose M £ M™ xn is nonnegative and irreducible. Then 

(1) 6 < p(M e ) < p{M) if and only if 6 < p{M); and 

(2) p{M) < p(Mg) <9 if and only if 9 > p(M). 

Proof. Suppose M € M" xn is nonnegative and irreducible. For 9 > and a nonzero 
A 6 K, let Mg — XI n +i be the block matrix 



Mg - XL 



11+1 



A 

C 



B 
D 
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where A £ R lxl and I n+ i £ R n+lxn+1 is the identity matrix. Then the matrix 
A = [A] and A" 1 = [1/A]. 



(19) Using the identity det 



A B 
C D 



det (A) • det(L> - CA~ l B) 



it follows that det(Mg - M n +i) = -Adet(Me(A) - AJ„) where Me (A) € 
the matrix given by 



(MKA)V . = 



My for (i,j)^(t,m) 

a{ +£ for = (£,m) 



for 1 < i,j < n. Therefore, M e (9) = M asa + £ = M fm . 

As M is nonnegative and irreducible then both p(M) > and p(M) £ cr(M) by 
the Perron-Frobenius theorem. Hence, 

det (M p(M) - p{M)I n+1 ) = -p{M) det (M p{M) (p(M)) - p(M)I n ) = 0. 

Therefore, p(M) £ p{M p(M) ). 

If G and Go are the graphs associated with M and M p (M) (0, M£ m ) respectively 
then G and Go have the same nontrivial strongly connected components. Hence, 

p(M p(M) (0,Mt m )) =p(M). 

Since the eigenvalues of a matrix are continuous with respect to the matrix entries 
then parts (b) and (c) of the Perron-Frobenius theorem imply p(M) = p(M p ( M )) 
so long as a > 0, C > and a + C = M( m . 

Let 7 > 1. As M p (M) is assumed to be both nonnegative and irreducible then 
proposition [4] implies 

p{M p (M)) < p{M lp{M) ) < p(jM p{M) ). 
Since p(7Af p (M)) = 7P(M) then letting 9 = jp(M) implies 

p(M) < p(M e ) < 9 if and only if 9 > p(M) 
as 9 > 0. Similarly, for < 7 < 1 it follows that 

9 < p{M e ) < p(M) if and only if 9 < p{M) 
completing the proof. □ 



If the matrix M in lemma 4.7 happens to be irreducible then the following holds. 

Corollary 3. Suppose M £ K nx ™ is nonnegative. Then p(Mg) < 9 if and only if 
p{M) <9. 

Proof. Suppose M £ R nxn is nonnegative. If M is irreducible then the result 
holds by lemma |4.7| If M is reducible then its associated graph G is not strongly 
connected and can be decomposed into the strongly connected components 

S(G) 1 ,...,S(G) N . 

Let Mi be the matrix associated with the strongly connected component S(G)^ and 
notice that each Mi is nonnegative. 

If vi,v rn £ S(G)i we consider two cases. First, suppose S(G)i is nontrivial. Then 
the graph Gg associated with Mg has the strongly connected components 

§(G) 1 ...,S e (G) l ,...,§(G) JV 
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where (Mg)i is the nonnegative matrix associated with Sg(G)j. As the matrix 
associated with a nontrivial strongly connected component is irreducible it follo ws 
that p((Mg)i) < 9 if and only if p(M) < 9. From equation (181, 



from lemma 



4.7 



p{M e ) = max{p(Mi), . . .,p((M e )i),. . .,p(M N )} = max{p(M), p{{M e ) l )}. 

Hence, if p{M) < 9 then p((Mg) z ) < 9 implying p(Mg) < 9. Conversely, if p(Mg) < 
9 then p(M) < 9 and the result holds in this case. 

If $(G)i is trivial then a,£ = and Mg has the strongly connected components 

§(G) 1 ,...,§(G) 7 v,S(G) A r +1 

where §(G)at + i is trivial with single vertex v . Hence, ct(Mjv+i) = {0} implying 
p(Mg) — p(M) by equation ( fl7| ). The result then follows in the case where the 
vertices vi,v m £ §(G)j. 

If ve £ S(G)i and v m £ S(G)j for i ^ j then the graphs associated with M and 
Mg have the same nontrivial strongly connected components. Equation ( 18 ) again 
implies that p(Mg) = p(M) which yields the result. □ 

A proof of theorem |4.2| is the following. 

Proof. Consider the time-delayed dynamical network ("H, X T ) with stability matrix 
A T . For I = IU 1% corollary [2] and equation ^ imply 

(20) d(A^(x| i ),-,A^(y| i )j) < ^Aijdixuyi) 

iex 

for all j £ I and x,y£ Xu as (Afu, X-u) has no local dynamics. For 5 = ij; Im £ 2^ 
let S — 1 = ij; I — 1, m. Since 

(21) %,5(xa_i) = for all 5 £ 1 H 
then without loss in generality we may assume 

fl if j' = 5- l 

(22) A ^ = in • j£l n . 

I otherwise 

as these constants are the smallest to satisfy equation |2]). We now consider two 
cases. 

Case 1: Suppose x\~ x is a variable of T~L m for i, m £ I. Let T-L m be the function 
H m in which the time-delayed variable x\~ x is replaced by x^~° and define 

(23) H = ( H 3 ) 8 (H m ). 

iei, 

Note that (AfyJ is then the function (Nn) in which the variable a^ m; ii is 
replaced by 2;^. Let I* = X — {£m; 11}. From equation (20 1 it follows that 

d(Mi(x|i)m,yVw(y|f)m) < A im d(a; i ,y i ) + At m d(xt,yt) + A M , m cZ(a; M ,y M ) 

iex*-{£} 

for all x,y £ X-u where p = lm\ 11. Hence, 

<2(A^(x| z «)m,A^(y|z«)m) < ki m d(xi,yi) + (A^ m + A M , m )d(x^,j/^) 

iei*-{c} 
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A/ m + A 




G 



G\ — G 



Figure 4. The edge e^ m in G and its modified form in G\ 
corresponding to case 1 in the proof of theorem |4.2| 



G 



(24) 



for i,j € I* 



for all x, y £ X^. As Hj = Hj for all j ^ m then the matrix A T given by 

'A y (i,j)^(£,m) 
^ A^ m + A M!m (i, j) = (£, m) 

is a stability matrix of (A/^,X^). 

By identifying the index /i with 0, equations (22) and (24) imply that the matrix 
Ag(a,£) = A for 8 = 1, a = A^ !m , and C = A^ m . Since A is nonnegative then 
corollary || implies p(A) < 1 if /7(A) < 1. Hence, p(A T ) < 1 if p{A T ) < 1. 



Case 2: For r > 1 and q,m (£ I suppose x k q T is a variable of W m and 



fc-(r-i) 



is not. Let H m be the function H m in which the time-delayed variable x q T is 



replaced by x\ ^ *\ Similar to case 1, let H be defined as in (|23|) where the 



indices of the dynamical network (Af-fi, X-fi) are relabeled such that gm; i — 1, r — 1 
is now gm; it for all 1 < i < r. 

Let I* = I — {(7m.; It} and the index qm; 2t = v. Then 



for j E Z* 



implying <f(A/#(x|x„ )j, A/"^(y|x„ )j) = d(x q , y 9 ) for j = v. This together with equa- 
tion ( 20 ) implies that the matrix A T given by 



(25) 



A, 



Ay (i, j) 7^ f ) 



1 



for i, j e I* 



(*,j') = (<?,f) 

is a stability matrix of (A/^,X^). 

Let 77 =_gm, tt. By identifying the index 77 with and 77 — 1 with £, equations 



(22) and (25) imply Ag(a,C) = A for 9 = 1, a = A ?) _i !?; , and £ = 0. As in case 1, 
it follows that p(A T ) < 1 if p(A T ) < 1. 

Observe that the dynamical network (U-h,X) can be obtained by sequentially 
replacing each timed-delayed variable x h e ~ T of (H, X T ) by x^"*- 1 " -1 * 1 as in case 1 and 
case 2. Specifically, this is done by first replacing all variables of the form x k t ~ Y 
then x\~ 2 and so on. Therefore, if p(A T ) < 1 then there exists a stability matrix A 
of (U-h,X) with p{A) < 1 where A is a stability matrix of (Uji, X) considered as a 
network without local dynamics. Theorem 2.3 therefore implies that (Uu,X) has 
a globally attracting fixed point. □ 



We note that the proof of theorem |4.2| gives a step by step procedure for con- 
structing a stability matrix of (Ufi,Xfi) from that of (H,X T ). This process is 
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V( • V m Vg • v m 

G G\ = G 

Figure 5. The edge ei m in G and its modified form in G\ = G 



corresponding to case 2 in the proof of theorem 4.2 



depicted in figures [4] andj5] which corresponds to cases 1 and 2 in the proof of 



theorem 



4.2 



The graphs G and G correspond to the matrices A and A respectively. 
Moreover, with respect to case 1 of theorem |4.2| we note the following. Suppose 
A T is a stability matrix of (Mf£,Xfi) and that the constants 

A ij =A ij for (i,j)^(£,m) where 

Then it is not necessarily the case that there exist constants A^ m , A M . m with the 
property Ag m + A^. m = An m such that A T is a stability matrix of (Afu, X-h). 
Therefore, knowing that p(A T ) < 1 does not give us any information on whether 
(Afu, Xf{) has a globally attracting fixed point. This is essentially what is happening 
in example 3. 

However, if the delayed dynamical network (H, X T ) is non-distributed then it is 
then possible to relate the stability of (Af-fi, Xfi) to the stability of (N-HtX-h)- This 
is the main idea in the following proof of theorem |4.4| 



Proof. Let (~H,X T ) g nd(X T ). Following the proof of theorem 
I U lu, X.* =1 — {£m; 11}, ft = £m; 11 and consider two cases. 



4.2 



we let X 



Case 1: For £, m G X suppose x\ 1 is a variable of H m - Then the assumption that 
(H,X T ) <E nd(X T ) implies T-L m does not depend on x^~° . Let i-L m be the function 



T~L m in which the time-delayed variable x\ 1 is replaced by x k t and define T~L as 



in equation ( 23 1 



Supposing A T is a stability matrix of (A/^,X^) then 
(26) rf(A^(x|x*)m,A/^(y|i.)m) < ^ ^i.rnd(x t ,yi) + At m d(xi>,x m ) 

for all x, y e X^. Moreover, as Ji rn does not depend on x^~° then any stability 
matrix A T of (Afu , X-u ) satisfies 



(27) d(M H (x\j-) m ,Af H (y\j-) m ) < ^2 A im d(xi,yi) + A^ m d(x ll ,y ll ) 

i6Z*-{£} 

for all x,y£ X-u since Ai m can be assumed to be zero. 

As (Af-fi) is the function (Affi) in which the variable X( m -n is replaced by xi 



then equations (26) and rt27fo imply that the matrix 



'Ay (i,j)^([i,m), (£,n), (£,m) 
,0 (i,j) = (£,m) 



, , A gm (i,j) = (n,m) . . ~ 
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is a stability matrix of (Af-u, Xfi). By identifying the index p with then the matrix 
Ag(a,£) = A for 9 = 1, a = A^ im and C = 0. As A > then corollary [3] implies 
p(A) < 1 if p(A) < 1. Hence, p{A T ) < 1 if p(A T ) < 1. 

Case 2: If Xp~ T is a variable of T-L m for r > 1 then again the assumption that 
(H,X T ) is non-distributed implies that T-L m does not depend on x\ ^ . Let H m 
be the function T-L m in which the time-delayed variable x k p ~ T is replaced by x k f ^ ^ 



and define H as in equation ( 23 1 



Using reasoning similar to that of the previous case where r = 1 it can be shown 
that if A T is a stability matrix of (Af-fi, X^) with p{A T ) < 1 then there is a stability 
matrix A T of (M-h,X h ) such that p(A T ) < 1. 

Let I be a stability matrix of (U-u,X). By proposition [3J A is then a stabil- 
ity matrix of (W^,X) considered as a dynamical network without local dynamics. 
Proposition [2] moreover implies that A = A T where 

d(Uu(^\z)jMn(y\x)j) < ^2^ijd(x i ,y l ) 



similar to equation ( 26 ) 



By sequentially replacing each variable x\~ T of (Uu,X) by a^~' T+1 ' 1 as in cases 1 
and 2 it follows that if p(A T ) < 1 then there exists a stability matrix A of (H, X T ) 
with the property p(A) < 1. As the converse of this statement holds by theorem 
|4.2|this completes the proof. □ 



5. Dynamical Network Expansions 

As mentioned in the introduction, a major obstacle in understanding the dy- 
namics of a network (or high dimensional system) is that the information needed 
to do so is spread throughout the various system components. In the remainder 
of this paper we consider whether it is possible to transform a dynamical network 
while maintaining its global stability and consolidating this network information. 
Our main goal is to gain improve estimates of a network's global stability using our 
results on time-delayed dynamical networks. 

5.1. Expanding Dynamical Networks. In this section we consider the method 
of dynamical network expansions introduced in [3]. In section 6 this method is 
combined with the techniques developed in section 3 to greatly simplify this method 
and introduce the theory of dynamical network restrictions. The results in this 
section are found in [3]. 

Recall from section 2 that for a given dynamical network (J 7 , X) the component 

F 3 ■ : Xi -> X for 1 < j < n. 

Following [3J we can alternatively write 

J r j(x\x :l )=J r j(x jl ,... > x jm ), where X i = . . . ,j m }. 

Note that if the variable Xj i of Tj is replaced by the function Q(y%, ■ ■ ■ ,yk) the 
result is the function 

•Fj \Xjn • • ■ 3 Xj i—1 , Q{yxi • • ■ i Uk) 1 Xj i+1 , ■ • ■ , x j m ) 
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having variables {x 3l , . . . , Xj i _ 1 , y±, . . . , yk, Xj i+1 , . . . , Xj m }. Additionally, if the se- 
quence 7 = l\ , . . . , £n let 

J-j- t j{xj l , . . . , Xj m ) = J-j{xj l ^, . . . , Xj m j). 

That is, the variables of the function J"j ;7 are indexed by the sequences ■ ■ ■ ,£n 
for 1 < i < to. 

Definition 5.1. For the graph Tjr = (V, E), let S C V such that each cycle of Tjr 
contains a vertex in S. If each vertex of V belongs to a path or cycle that begins 
and ends with a vertex of S then S is called a complete structural set of Tjr. 

For the graph Tj- let st (Tj-) be the set of all complete structural sets of Tj-. 
For S = {vi, . . . , v m } G st (Tjr) let I s = {1, . . . , to} denote the index set of 5*. 

Definition 5.2. For £ G sto(Tjr) and i, j G Is let Bij(Tjr\ S) be the set of paths 
and cycles of Tjr from Vi to vj that have no interior vertices in S. The set 

£s(r»= U *«(i>;S) 

is called the branch set of Tjr with respect to S. 

This notion of a branch set allows us to introduce the following. 
Definition 5.3. For S G st a (Tj-) let the set 

(28) As(T) = {£!,..., £ N :v ei ,...,v e „ e B s (Tj-), N > 2} 
be the set of admissible sequences (paths) of T with respect to S 1 . 

Let (J", X) be a dynamical network with graph of interactions Tjr — (V, E) and 
suppose S G st (Tj-). For j G Xg let be the function 

•^j = ^3 ( X 3i ' - - - ' X J»n ) 

in which each variable a;^ is replaced by Xj e j if jg Is- 
For i > 1 let be the function 

in which each x 7 ^ = xg lt ...^ N is replaced by the function J 7 e 1 -,^ e if ^i <£ls- If ^i G Is 
for each 1 < I < t then define (Xs^j = ■ 

Let •y = £i,...,£ff G As(J"). For 1 < i < |t_| = iV define the N - 2 spaces 

Additionally, define the functions 

(29) XsFi-tjixi-it-y) = Xi-i iT 
By way of notation we let 

(30) A/v_i, 7 = Xj, Xs^N-i.y = XsJ~~ n and x\^ — xg 1 . 
Definition 5.4. Suppose £ G st (Tj-). Let 

= ( ® W-) © ( Win) • 

l<i<H 
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Vl V 2n V 2 n-1 




V3 r, V 2n -3 

1 F 



Figure 6. The graph of interactions Tjr for the dynamical net- 
work in example 5 



and 

*sr=(0*i)®( 

Ki<|7| 

The dynamical network (XgT, Xg) is called the expansion of (J 7 , A) with respect 
to S. 

Theorem 5.5. The dynamical network (J 7 , X) has a globally attracting fixed point 
if and only if the expansion also has (XgJ 7 , Xg) a globally attracting fixed point. 

In [5] it is shown that if the expansion (XgJ 7 , Xg) has a globally attracting fixed 
point then the same holds for (J 7 , X). The converse holds by simply reversing the 
argument and so is omitted. 

As there is no natural decomposition of the expansion (XgJ 7 , As) into a set of 
local systems and an interaction we consider (XgJ 7 , Xg) as a network with no local 
dynamics. By proposition [2] a stability matrix of (XgJ 7 , Xg) therefore has the form 
A T where the constants A i:) satisfy equation ^ for F = XgT . The following is an 
immediate corollary of theorem |5.5| and theorem |2.3| 

Corollary 4. Suppose A T is a stability matrix of the expansion (A5J 7 , Xg). If 
p(A T ) < 1 then (J 7 , A) has a globally attracting fixed point. 

As has been shown, expansions always allow for better estimates (or at least 
no worse) of a dynamical network's global stability. This fact is a combination of 
theorem |5 . 5| and the following. 

Theorem 5.6. Let (XgJ-, Xg) be an expansion of (J 7 , A) and suppose A T is a 
stability matrix of (J 7 , A). Then there is a stability matrix A T of (XgJ 7 , Xg) such 
that p(A T ) < p(A T ). 

Example 5. Consider the dynamical network (J 7 , A) given by 

^j(x) = tanh(a;j_i) + tanh(:Ej +1 ) + c 

with local systems ipi(xi) = tanh(:Ej) and interaction 

Fj(xj-i,Xj + i) = Xj-i +x J+ i +c 

for 1 < i,j < 2n where the indices are taken mod In, Aj = R, and c > 0. Note 
that this network is a variant of the Cohen-Grossberg model introduced in section 
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2-4 With C = 1, Cj = C, 



Wij = 



1 j=i±l 
otherwise 



and where we allow e = 1. As J- G Cl (M 2n ) then for Ay = max^^ \{DF)ji{x)\ 
and Li = max l6 x IVi( a; i)l the m atrix A — A T ■ diag[Li, . . . , L2„] given by 



A 



1 



is a stability matrix of (J 7 , X). Since A has the constant row sums 2 i/ien = 2. 
Therefore, theorem 2.3 cannot directly be used to imply that (J 7 , X) has a globally 
attracting fixed point. 

However, note that the vertex set S = {v%, i>4, . . . , V2n} has the property that each 
cycle ofTjr contains a vertex of S (see figure^. Moreover, as 



(31) 



#s(I>) = {v i} Vj,Vk .iel s , j = i± l,k = j± 1} 



where each index is taken mod 2n then each vertex of Tjr belongs to a path or cycle 
of Bs(Tjr). Hence, S is a complete structural set ofTjr. 

Note that if j G I5 then j ' ± 1 $.X$. Replacing the variables Xj—i and Xj+i of 
Tj by Xj—i t j and Xj+i,j respectively results in the function 

Given that the variables Xj-ij and Xj+ij of Fu,i) are indexed by sequences be- 
ginning with elements not inTs then they are replaced by J~j-i-.j-i.j and J~j+i-.j+i.j 
respectively to form F(j,2) ■ That is, 

F(j,2) = (Fj- 1 (Xj-2 ,j - 1 ,j , Xj j _ 1 J ) , Fj+i (Xj j + i j,Xj +2 ,j+l,j)). 

As j G Ts implies j ± 2 G Xg then each variable of Tups is indexed by a sequence 
beginning with an element 0/I5. Hence, X$J~j — J~{j,2} f or j € %s- Moreover, it 



follows from (31) that 

A S (F) = {i,j, k : i G I 8 ,j = i± l,k = j ± 1} 

where each index is taken mod 2n and n > 2. For each i, j,k = 7 G AsiJ 7 ) there is 
then a single function corresponding to 7 where 

Xs ■ Xi- n ->• X 2 - n given by X s J 7 2, 1 {x 2 - n ) — x 2;7 . 



By use of {30), this function can be written as XgT^ixi 



Following definition \5.4\ the expansion X$T : Xs ~ > Xs is given by 







XsTi 




Xs^2n,l,2 




(32) 


XsH*) = 


XsJ-2n 


e 


Xs^2,l,2n 


where 



X s Fk,i, m {xk) = x k for k,l,m G Asp 7 ) and 
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^X S F 

Figure 7. The graph of the expansion (XgJ-, Xs) in example 5 
where i — 2n — 4, j — 2n — 3, k = 2n — 2, / = In — 1, m = In 



XsJ-j =tanh \tanh(Xj-2,j-i,j) + tanh^Xjj-ij) + c] + 
tanh [ tanh(xj,j+i.j) + tanh(xj + 2 ,j) + c] + c 
for j G {2, 4, . . . , 2n}. Moreover, the space 



■it 

Xs = (®x 3i )®( x : 



T)5» 



The graph of interactions Tx s f * s shown in figure^ 

Let AsTj = {a, b,j e AsJ~}. For every j elj, DXgT has the form 

(DXsJ-)ji(x.) = sech 2 (xi) sech 2 (c + tanh(xj) + tanh(ajfe)) 

w/iere i,fce AsFj- Hence, max^ e x s K-DAsJ^-^x)! < sech 2 (c — 2) for each j G Xg, 
i G AsJ^j, and c > 2. One can compute that for c > 2, 

'sech 2 (c - 2) /or jel s , i G 

1 / or J = k,l,m; i = k 

otherwise 

gives a stability matrix A T of (XgT, Xg). 

To compute the spectral radius of A T let A — Xl2n be the block matrix 

A B 



A; 



A - XI 2 n = 



C D 



where A G M. nxn is the matrix with rows and columns indexed by I5. Hence, 
A = XI n implying A^ 1 = X~ 1 I n f or X 7^ 0. 

Using the identity in equation (19) it follows that det(A — XT) = dct(A _1 A — XI) 
where the matrix A G R nx ™ is given by 



A = 



2 sech 2 (c- 2) sech 2 (c-2) 
sech 2 (c-2) 



sech 2 (c - 2) 



sech 2 (c- 2) 



sech 2 (c-2) 
sech 2 (c-2) 2sech 2 (c-2) 



Since each row sum of A is 4 sech 2 (c — 2) then p(A) — 4 sech 2 (c— 2). 
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As det(A - XI) =dct(\- 1 A-XI) then det(A - AI) = only z/det(A — A 2 /) = 
and so Zong as A ^ 0. Hence, any nonzero A 6 C is an eigenvalue of A on/y i/ 
±-y/|Ao| is an eigenvalue of A. Therefore, 



p(A) = J p(A) = 2 scch(c - 2) . 



,4s 2sech(c - 2) < 1 /or c> 2 + sech ^l/SJ] 
a globally attracting fixed point by theorem 



3.31 £/ien (J 7 , A) does m /aci have 
2.^forc> 2 + seclT 1 (l/2). 



In the next section we combine the results of section 4 on removing time delays 
with the theory of dynamical network expansions to greatly simplify the computa- 
tional process in constructing and analyzing a dynamical network expansions. 



6. Restrictions of Dynamical Networks 

In the previous section we introduced the notion of a dynamical network expan- 
sion. In this section we show that any such expansion has the form of a delayed 
dynamical network. By removing these delays we will be able to develop a new 
procedure of dynamical network restrictions. 

As with dynamical network expansions such restrictions allow for improved sta- 
bility estimates of a dynamical network's global stability. However, the computa- 
tional effort needed to carry out this restrictions procedure is far less when compared 
with the procedure of constructing and analyzing expansions in section 5. 

We note that restrictions are somewhat similar to the dynamical network re- 
ductions introduced in [3 . The fundamental difference though is that dynamical 
network reductions preserve the spectrum of a dynamical network whereas the re- 
strictions we introduce involve the removal of time-delays and so do not have this 
property. 

6.1. Restricting Dynamical Networks. Let (J 7 , X) be a dynamical network and 
suppose S G st (Tjr). For j £ I s let J-(jfl) = F° r * > 1 define Tun to be the 
function 

in which each variable Xj t is replaced by the function Tj t if je £ls- 11 it € Is for 
each 1 < I < to then let !ZsJ~j = Jv^i-i)- Note that if TlsTj — J-(j.i-i){ x i, ■ ■ ■ , x m ) 
then {1, . . . , to} C Xg, 

Definition 6.1. Suppose S € st (Tjr). Let X\s — ®j e x s ^ an< ^ define 

TZ S T= K s T r 

jeis 

The dynamical network (TZgJ 7 , X\s) is called the restriction of the dynamical net- 
work (J 7 , X) to S. 

As is the case with dynamical network expansions we consider the restriction 
(IZsJ 7 , X\s) to be a dynamical network without local dynamics. We also note that 
the restriction (1ZsJ~, X\s) is simpler than the original dynamical network in at 
least two ways. The first is that (HgJ 7 , X\s) is a lower dimensional system than 
(J 7 , X). The second is that the graph F Ks jr structurally simpler having less vertices 
and edges than Tjr and potentially less paths and cycles, etc. 
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Figure 8. The graph of interactions of (7, X) and its restriction 
{IZsF, X\s) in example 6 



Example 6. Consider the dynamical network (J-, X) of the form 



7i(x 6 ) 

7 2 (a5l) 

74(353) 

7e(x 5 ) 



Note that S = {i>i, i>3, «s} is a complete structural set of the graph of interactions 
Tjr shown in figure^ (left). Replacing each of the variables X4 by 7, in each Tj for 
i <£Ts and j G T$ yields the functions 

7(i,i) = 7i(7 6 (a; 5 )), 

7"(2,i) = 7 3 (7 2 (xi),a;5,7 6 (a; 5 )), 

7(3,i) = 75(72(2:1), ^3,74(0:3)). 

Since each variable o/7(i,i), 7(2,1), (11^(3,1) is indexed by an element of Is then 
!ZsJ~ ■ X\s —> X\s is given by 

7i(7 6 (x 5 )) 
7 3 f7 2 (a;i),a; 5 ,76(x 5 )) 
7 5 (7 2 (a;i),X3,74(a; 3 )) 

The graph of interactions Tn s jr is shown in figure^ (right). 

Theorem 6.2. Suppose A is a stability matrix of the dynamical network (7, X) 
If p(A) < 1 then any restriction (7£<j7, X\g) has a globally attracting fixed point. 



That is, if a dynamical network is known to be stable by theorem |2.3| the same 
then is true of any of its restrictions. However, if the restriction (7£s7, X\s) is 
known to be stable it is not always the case that the unrestricted system (7, X) has 
a globally attracting fixed point. To determine when this is the case we introduce 
the following concept. 

Definition 6.3. Let S be a complete structural set of Tjr. Then S is called a basic 
structural set of Tjr if 

|fly(I>;S)| < 1 for all i,j€l S . 

If S is a basic structural set of IV we write S € bas(Tjr). The notions of a 
basic structural set and a non-distributed interaction arc related and allow us to 
formulate and prove the following theorem. 
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Theorem 6.4. Suppose S G bas(Tjr). If A is a stability matrix o/ (J 7 , X) with 
the property p(A) < 1 then (IZgjF, X\$) has a globally attracting fixed point. Con- 
versely, if A is a stability matrix of (TZsJ 7 , X\s) with p(A) < 1 then (T,X) has a 
globally attracting fixed point. 



Before giving the proof of theorem |6.2| and |6.4| we consider the following example. 

Example 7. As in example 5 let (J-, X) be the dynamical network given by 

J-j(x) = tanh(:Ej_i) + tanh(:Ej + i) + c 

for 1 < j < 2n where the indices are taken mod In, X; L — R, and c > 0. As 
S = {v2,V4, . . . , «2n} is a complete structural set ofYjr then the dynamical network 
restriction (TZsJ 7 , X\s) is defined and is constructed as follows. 

For j € Is the component function Tj = has variables Xj-i and Xj+i 

where both j ± 1 ^ Is. The function is then 

■^UA)( x j- 2 ' x j' x j+ 2 ) =tanh [tanh(xj_2) +tanh(x :) -) +c] + 
tanh [tanh(xj) + tanh(xj + 2) + c] + c 

Since each variable of -^(^i) is indexed by an element of Is then Fm i) = TZsFj- 
Therefore, the dynamical network restriction (IZsJ 7 , X\s) is given by 

n 

TZsJ 7 = 0^S^2j and X\ s =R n . 

The graph of interactions T^jr is shown in figure^ Moreover, as 

!1 j=i±2 
1 .1 > for i,jel s 
otherwise 

then S £ bas(Tjr). As in example 5 one can compute that 

!2 sech 2 (c — 2) for i — j 
sech 2 (c~2) for i=j±2 
otherwise 

for j G Is and c > 2. Hence, the matrix A given in example 5 is a stabili ty m atrix of 
(IZsJ 7 , X\s). Since p(A) = 4sech 2 (c— 2) then as in example 5 theorem 6.4 implies 



that the original unrestricted network (J 7 . X) has a globally attracting fixed point if 
c > 2 + sechT 1 (l/2). 

Importantly, if we were to analyze (T,X) as a Cohen- Grossberg network using 



theorem 2.4 (allowing e = 1) we could not deduce the stability of the system for 
any value of c. In fact, the stability criteria in theorem \2.4\ does not depend on 
the constants Cj . However, by use of a dynamical network restriction we gain more 
information about the stability of such networks. Specifically, it follows that the 
stability of the Cohen-Grossberg networks considered in section 2.2 depend on C, 
p(\W\), and the values of Cj for e«l. 

It is also worth mentioning again that both the process of constructing (TZsJ~, X\s) 
and analyzing its stability are significantly simpler than finding and analyzing the 
expansion (A5J-", Xg) in example 5. (As evidence, one can compare the graphs 
r^ s jr and Tn s jr in figures 7 and 9.) This should not be surprising based on how 
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V2n 




Figure 9. 



expansions and restrictions are defined. In fact, for any dynamical network (J 7 , X) 
it is always computationally easier to analyze the restriction (IZsJ 7 , X\s) compared 
with the expansion (As J 7 , Xs). 

In examples 5 and 7 both expansions and restrictions were used to gain improved 
stability estimates of the untransformed dynamical network (J 7 , X). Although using 
the restrictions ( 72-5 J 7 , X\s) was computationally and procedurally simpler than 
using (XgJ-, Xs) both gave the same improved stability estimate. This outcome is 
not a coincidence but holds in general. 

Theorem 6.5. Suppose S £ bas(Tjr). There is a stability matrix A T of (AgJ 7 , Xs) 
with property p(A T ) < 1 if and only if there is a stability matrix A T of (!ZsJ~, X\s) 
such that p(A T ) < 1. 

As a final observation, in this section, we note that it is often possible to sequen- 
tially restrict a dynamical network and thereby sequentially improve ones estimate 
of whether the original (untransformed) network has a globally attracting fixed 
point. Moreover, it is possible to use restrictions to get improved stability esti- 
mates of the time-delayed network (H 1 X T ) by restricting the undelayed system 
{U m X). 

6.2. Proof of Theorems |6.2[ 1 6 . 4 [ , and |6.5[ The major idea needed to prove 
the theorems of the previous section is that any dynamical network expansion is 
related to a time-delayed dynamical network. More specifically, for the expansion 
(XsF, Xs) any admissible sequence 7 = 0, . . . , r — 1 £ As{J-) corresponds to the 
functions 

(33) XsFi;j{Xi-l,~f) — £»-l,7 

for 1 < i < That is, after r — 1 iterates the function XsJ- T -i depends on the 
value of xq. Therefore, every admissible sequence 7 £ As{J~) corresponds to a time 
delay. By formally introducing delays into the expansion we can relate the stability 
of (XsF, Xs) to that of (IZsJ 7 , X\s) using techniques from sections 3 and 4. This 
can be done as follows. 

For v = 0, . . . ,t - 1 £ AsiJ 7 ) let 

AJ^Pj = AsiJ 7 ) - v and Ty = (X s - {r - 1}) U v. 

Let XsP be the function XsJ- T -i in which the variable x v is replaced by the time 
delayed variable £q ^ r ~^. 



30 



L. A. BUNIMOVICH 1 AND B. Z. WEBB 2 



Observe that the map V^iXsT) : XI — > X v given by 



V V _{X S T) = ( X S T^) © ( X S T V . 

1<*<|7| 

(©*>)©( e x 



with 



X v = 



Ki<|7| 

defines the time-delayed dynamical network (D„ (A^J 7 ] , X£). By identifying the 
index 0,t-1;i-1,7-2£ T-t> v {XsT) with the index i; v_ for 1 < i < t — 1 then 
(AfvutXsF)) Xs) — (XsJ 7 , Xs). This follows from the fact that the functions 

„(Ar s ^))o,T-l;i-l,r-2(afQ,T-l;i-2,r-2) — *0,T-l;i-2,T-2 and 

have the same form (see equations Q and (29 1). By sequentially modifying the 



expansion (XgF, Xs) in this manner over all admissible sequences in As (J - ) the 
result is the time-delayed dynamical network 

{V As[T) {X s T),Xl s{T) ) where T= max | 7 | - 2. 

7_e-As(-^) 

For simplicity we let V^ s ^{XsiF) = T>sF and note that the product space 
X^sir) = X\s- Hence, the dynamical network 

{M- Ds r,Xs) = {X s T,Xs) 

by identifying the index £i,£^;i — 1,£n — 1 6 1-v s r with the index i; 7 for all 
7 = £i, . . . , £jv G As (.7-"). The following is then a result of theorem 



3.3 



Lemma 6.6. Let S € sto(IV). Then (DsJ 7 , X\g) has a globally attracting fixed 
point if and only if the same is true of the expansion (Xg!F,Xs). 

Moreover, note that for j € X by replacing each time delayed variable x\~ l of 
VsJ~j by Xi the result is the function 1ZsFj. Therefore, 

(34) (Uv s r,X\s) = (K s F,X\ s ). 

We now give a proof of theorem |6.2| 



Proof. Suppose A is a stability matrix of (J-, X) with p(A) < 1. Hence, (J 7 , X) 
has a globally attracting fixed point. Theorem |5.5| together with lemma [6~6| then 
imply that (T>sJ-, X\g) also has a globally attracting fixed point. The undelayed 



dynamical network (Uvsf, X\s) is then globally stable by theorem 4.2 and the 



result follows from equation (34) as (Uj) s jr 1 X\s) = (IZsJ-, X\g). □ 

A proof of theorem |6.4| is the following. 
Proof. Suppose 5 € bas(Tjr). If A is a stability matrix of (J 7 , X) with p(A) < 1 then 



theorem 6.2 implies (TvLsJ 7 , X\s) has a globally attracting fixed point. Therefore, 
suppose A is a stability matrix of (IZsJ-, X\s) with the property p(A) < 1. 

Since 5 e bas(I» then it follows that (T> S T,X\^) G nd(X|f). As the unde- 



layed network (Wx> s jf,X|s) = (71$ J 7 , X\§) then theorem 4.4 implies that there is 



a stability matrix A of (Uu s jr 1 X\ s ) such that p(A) < 1. Lemma 6.6 combined 
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with theorem 5.5 then imply that the dynamical network ( J-, X) has a globally 



attracting fixed point. □ 

Note that in the proof of theorem |6. 5 1 the assumption that S € bas(Tjr) implies 
that the network (V s T,X\l) G nd(X\£). Since (U-p s F,X\s) = (^ s J",X|s) then 
theorem |4.4| directly implies the result of theorem |6.5| 



7. Concluding Remarks 

This paper continues the analysis of useful transformations of dynamical net- 
works initiated in [3]- Here, we analyze time-delayed dynamical networks and their 
global stability. Because analyzing the global stability of a network requires knowl- 
edge of its spectral radius, rather than the knowledge of its entire spectrum, we are 
able to introduce a new much simpler class of dynamical network transformations, 
which we call network restrictions. Such restrictions allow us to study the global 
stability of dynamical networks in a simpler and computationally more efficient way 
compared with the isospectral networks expansions found in j3]. However, we note 
that as such expansions preserve the entire spectrum of the network they provide 
more information about the dynamical network. 

A key ingredient in our procedure of dynamical network restrictions is the notion 
of a basic structural set of the network's graph of interactions. These sets form 
a subclass of structural sets introduced in Our approach here allows us to 
prove that dynamical networks and their time-delayed versions with non-distributed 
delays are globally stable or unstable simultaneously. We observe that this is not 
true in general for dynamical networks with distributed delays. 

The theory developed in this paper is illustrated by various examples of Cohen- 
Grossberg neural networks. Importantly, this approach to analyzing the global 
stability of networks is not limited in any way to this class of networks and could 
be applied to any (time-delayed or undelayed) dynamical network. We fully expect 
that this theory will prove to be useful for the analysis of other features, structures, 
and dynamics of networks. 
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